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WHAT IS CLAIMED IS: 

1. A system for riaodifying an image having pixels, comprising: 
means for automatically identifying a main subject of the image, 

and 

means for altering pix^l values to emphasize said main subject. 

2. The system of ClaimU wherein said means for altering 
emphasizes said main subject by altering^ pixel values that are a part of said main 
subject. 

3. The system of Claim 1 wherein said means for altering 
emphasizes said main subject by altering pijcel values that are not a part of said 
main subject. 

The system of Claim 4 wherein said means for identifying 

further comprises: 

means for segmenting the image into a plurality of regions based 
on uniform image characteristics^ 

means for calculating sN^yel of saliency for said plurality of 

regions, and 

means for assigning a believe value to the pixels^sqrresponding to said level of 
saliency. 

5. The system of Claim 4 wherein said image characteristic is pixel 
color. \ 

6. The system of Claim 4 wherein said image characteristic is 

texture. 



# 
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7. The systenrof Claim 4 wherein said means for calculating 
calculates said level of saliencyVs proportional to a region feature. 

8. The system of Craim 4 wherein said means for calculating 
calculates said level of saliency as proportional to a combination of region 
features. 



9. The system of Claim 4 wherein said means for calculating 
calculates said level of saliency as proportional to a structural region feature. 

10. The system of Claim 4 wherein said means for calculating 
calculates said level of saliency as proportional to a semantic region feature. 



1 1 . The system of Clai n 4 wherein said means for segmenting 



orders said belief values according to a 



probability that a region is a main subject. 



) a probat 



12. A system of modifying an image having pixels, comprising: 
means for automatically generating at least a first belief value 
associated with one of a plurality of regions of the image, said belief values 
related to the probability that the associated region is a main subject of the image 
and 

means for altering pixej values in said plurality of regions in 
relation to said associated belief value 



13. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises a means for desaturating 

the pixels in said background regions. 
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14. The systen\in Claim 13 wherein said means for desaturating 
further comprises: 

means for calculatiii^ the luminance values for the pixels in said 
background regions, and 

means for replacing thA color values of the pixels in said 
background regions with their respective luminance values. 



15. The system of Claim 1j£ wherein said means for altering 

further comprises: 

means for computing a saturation value for each pixel, and 
means for altering the pixel saturation values according to said 

associated belief values. 



16. The system of Claim 12 farther comprising: 
means for determining a threshold belief value discriminating main 
subject regions and background regions, and wherein 

said means for altering further comprises a means for enhancing 
saturation of the pixels in said main subj ecu regions. 



17. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises: 
means for computing a saturation value for each pixel in said 

background regions, and 

means for altering the f>ixel saturation values in said background 

regions according to said associated /belief values. 



18. The system of/Claim 12 further comprising: 
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means for deWmining a threshold belief value discriminating main 
subject regions and backgroundo'egions, and wherein 
said altering meanis further comprises: 

means for computing a saturation value for each pixel in said main 
subject regions, and 

means for altering the hixel saturation values in said main subject 
regions according to said associated belief values. 



19. The system of Claim \2 wherein said means for altering 
further comprises: 

means for computing a luniinance value for each pixel, and 
means for altering the pixel \luminance values according to said 
associated belief values. , 

20. The system of Claim 12 iirther comprising: 

means for determining a threshold belief value discriminating main 



wherein 

r comprises means for altering the 



subject regions and background regions, anc 
said means for altering further 
pixel luminance values in said main subject {regions according to said associated 
belief values. 



21. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises means for altering the 

pixel luminance values in said main sul^ect regions according to said associated 

belief values. 



22. The system of Claim 12 wherein said means for altering 
further comprises: / 
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means for conijanting a hue value for each pixel, and 

means for alteringthe pixel hue values according to said associated 



belief values. 



23. The system of Claim 12 further comprising: 

means for determining a tmeshold belief value discriminating main 
subject regions and background regions, anSd wherein 

said means for altering further comprises means for altering the 
pixel hue values in said main subject regionsjaccording to said associated belief 
values. 

24. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 
subject regions and background regions, and \ /herein 

said means for altering further comprises means for altering the 
pixel hue values in said main subject regions iccording to said associated belief 
values. 



25. The system of Claim 12 further comprising: 
means for determining a threshold belief value discriminating main 
subject regions and background regions, and wherein 

said means for altering further comprises means for inverting the 
pixel hue values in said main subject regfons. 



26. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises means for of inverting the 

pixel hue values in said background regions. 
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27. The system of Claim 12 wherein said means for altering 
further comprises: 

means for computing a blur value for each pixel, and 
means for altering tnp pixel blur values according to said associated 

belief values. 



28. The system of Claim 12 further comprising: 

means for determining a threshold belief value discriminating main 
subject regions and background regions,\and wherein 

said means for altering further comprises means for calculating a 
pixel blur value for each pixel, and means for altering the pixel blur values in said 
background regions according to said asscpiated belief values. 

29. A system of modifying an image having pixels, comprising: 
means for automatically generating a main subject belief map 

containing values indicating the location of a plurality of regions in the image, 
said main subject belief map containing at 
one of said plurality of regions, said belie 
associated region is a main subject of the 
means for altering pixel v 
relation to said associated belief value 



least a first belief value associated with 
values related to the probability that the 
mage; 

ues in said plurality of regions in 



30. The system of Claim/29 further comprising: 

means for determining aithreshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering /further comprises a means for desaturating 

the pixels in said background regions/ 



3 1 . The system in C/aim 30 wherein said means for desaturating 
further comprises: 
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means for calculating the luminance values for the pixels in said 
background regions, and \ 

means for replacing the color values of the pixels in said 
background regions with their respective luminance values. 

32. The system of Claim 29 wherein said means for altering 
further comprises: \ 

means for computing a samiration value for each pixel, and 
means for altering the pixql saturation values according to said 
associated belief values. \ 

33. The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 
subject regions and background regions, an I wherein 



saturation of the pixels in said main subject regions. 

34. The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions/and wherein 

said means for altering further comprises: 

means for computing a saturation value for each pixel in said 

background regions, and / 

means for altering the /pixel saturation values in said background 

regions according to said associated/belief values. 




35. The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 



subject regions and background regions, and wherein 
said altering means further comprises: 
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means for competing a saturation value for each pixel in said main 
subject regions, and 

means for altering th£\pixel saturation values in said main subject 
regions according to said associated belief values. 



36. The system of Claim 3p wherein said means for altering 
further comprises: 

means for computing a lumiAance value for each pixel, and 
means for altering the pixel liuninance values according to said 
associated belief values. 

37. The system of Claim 29 f irther comprising: 
means for determining a thres lold belief value discriminating main 

subject regions and background regions, and wkesein 

said means for altering furthe s OTmprises means for altering the 
pixel luminance values in said main subject Regions according to said associated 
belief values. 



38. The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises means for altering the 

pixel luminance values in said main sub/ect regions according to said associated 

belief values. 



39. The system of Claiin 29 wherein said means for altering 
further comprises: 

means for computing dhue value for each pixel, and 
means for altering the pixel hue values according to said associated 

belief values. 
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40. The systeniof Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises means for altering the 

pixel hue values in said main subject regions according to said associated belief 

values. 



41 . The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering furth sr comprises means for altering the 

pixel hue values in said main subject regior s according to said associated belief 

values. 



further comprising: 

shold belief value discriminating main 



42. The system of Claim 29 

means for determining a tl 
subject regions and background regions, afid wherein 

said means for altering further comprises means for inverting the 
pixel hue values in said main subject regions. 



43. The system of Claim 29 further comprising: 

means for determining a threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering further comprises means for of inverting the 

pixel hue values in said background/regions. 



44. The system of jtlaim 29 wherein said means for altering 
further comprises: 

means for computing a blur value for each pixel, and 
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means for altering the pixel blur values according to said associated 



belief values. 



45. The system of Clakn 20 further comprising: 

means for determining threshold belief value discriminating main 

subject regions and background regions, and wherein 

said means for altering furtner comprises means for calculating a 

pixel blur value for each pixel, and means for altering the pixel blur values in said 



background regions according to said assoc 



46. A method of modifying 



ated belief values. 



iin image having pixels, comprising 



the steps of: 



automatically identifying a main subject of the image, and 
altering pixel values to emphasize said main subject. 



47. The method of Claim 46 wherein said main subject is 
emphasized by altering pixel values that are a part of said main subject. 

48. The method of Claim 46jwherein said main subject is 
emphasized by altering pixel values that are not a part of said main subject. 



49. The method of Claim 4p wherein said identifying step 
comprises the steps of: 

segmenting the image int</ a plurality of regions based on uniform 
image characteristics; 

calculating a level of satfency for said plurality of regions, and 

assigning a believe valuje to the pixels corresponding to said level 
of saliency. 



pixel color. 
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50. The method of Claim 49 wherein said image characteristic is 



51. The method ofNClaim 49 wherein said image characteristic is 



texture. 




52. The method of Claim 49 wherein said level of saliency is 
calculated as proportional to a region feature. 



53. The method of Claim 
calculated as proportional to a combination 



54. The method of Claim 
calculated as proportional to a structural 



55. The method of Clainr^ 
calculated as proportional to a semantic 



49 wherein said level of saliency is 
of region features. 



49 wherein said level of saliency is 
] egion feature. 



49 wherein said level of saliency is 
] egion feature. 



56. The method of Clain 
according to a probability that a region 



49 wherein said belief values are ordered 
amain subject. 



57. A method of modifying an image having pixels, comprising 
the steps of: / 

automatically generating at least a first belief value associated with 
one of a plurality of regions of the image, said belief values related to the 
probability that the associated region is a main subject of the image; 

altering pixel values im said plurality of regions in relation to said 
associated belief values. 

58. The method of Claim 57 further comprising the steps of: 
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determining ^threshold belief value discriminating main subject 
regions and background regions,Wd wherein 

said altering step comprises the step of desaturating the pixels in 
said background regions. 



59. The method in Claim^8 wherein said desaturation step 
comprises the steps of: 

calculating the luminance values for the pixels in said background 
regions; 

replacing the color values of t\ 
with their respective luminance values. 



60. The method of Claim 57 
the steps of: 

computing a saturation value 

altering the pixel saturation \falues according to said associated 
belief values. 



le pixels in said background regions 



- " wherein said altering step comprises 



for each pixel, and 



61 . The method of Claim 37 further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and wherein 

said altering step comprises the step of enhancing saturation of the 

pixels in said main subject regions. 



62. The method of Claim 57 further comprising the steps of: 
determining a threshold belief value discriminating main subject 
regions and background regions, ana wherein 

said altering step comprises the steps of: 

computing a saturation value for each pixel in said background 
regions, and / 
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altering the pixel saturation values in said background regions 
according to said associated belief Wues. 

63. The method of Claim 57 further comprising the steps of: 
determining a threshold belief value discriminating main subject 
regions and background regions, and wherein 

said altering step comprises the steps of: 

computing a saturation vahr£ for each pixel in said main subject 
regions, and 

altering the pixel saturation values in said main subject regions 
according to said associated belief values. 



64. The method of Claim 57 ^herein said altering step comprises 
the steps of: 

computing a luminance value for each pixel, and 
altering the pixel luminance valjues according to said associated 
belief values. 



65. The method of Claim 57 fukher 
determining a threshold belief vjalue 

regions and background regions, and wherein 
said altering step comprises the 

values in said main subject regions according t 



comprising the steps of: 
discriminating main subject 



step of altering the pixel luminance 
said associated belief values. 



66. The method of Claim 57 ftrther comprising the steps of: 
determining a threshold belieijfvalue discriminating main subject 
regions and background regions, and whereij 

said altering step comprises Ahe step of altering the pixel luminance 
values in said main subject regions according to said associated belief values. 



+ 
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67. The method q£ Claim 57 wherein said altering step comprises 
the steps of: 

computing a hue valiie for each pixel, and 
altering the pixel hue values according to said associated belief 

values. 

68. The method of Claim\57 further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and wherein 

said altering step compriseslthe step of altering the pixel hue values 
in said main subject regions according to said associated belief values. 



69. The method of Claim 5^ fS^ther comprising the steps of: 
determining a threshold belief value discriminating main subject 
regions and background regions, and wherein 

said altering step comprises t le step of altering the pixel hue values 
in said main subject regions according to saild associated belief values. 



70. The method of Claim 57/further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and wherein 
said altering step comprises 

values in said main subject regions. 



the step of inverting the pixel hue 



71 . The method of Claim 57 further comprising the steps of: 
determining a threshold be ief value discriminating main subject 
regions and background regions, and whei ein 



said altering step comprise 
values in said background regions. 



; the step of inverting the pixel hue 



# 
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the steps of: 



72. The method oiyClaim 20 wherein said altering step comprises 

computing a blur value for each pixel, and 

altering the pixel blur values according to said associated belief 



values. 



73. The method of Claim 57 further comprising the steps of: 
determining a threshold belief value discriminating main subject 



regions and background regions, and wl 



erein 



said altering step compris es the steps of calculating a pixel blur 
value for each pixel, and altering the pixel blur values in said background regions 
according to said associated belief values. 

74. A method of modifying an image having pixels, comprising the 

steps of: 

automatically generating a nain subject belief map containing 
values indicating the location of a plurality of regions in the image, said main 
subject belief map containing at least a firs t belief value associated with one of 
said plurality of regions, said belief value: 
associated region is a main subject of the 

altering pixel values in sai 
associated belief value. 



related to the probability that the 
mage; 

plurality of regions in relation to said 



75. The method of Claim 
determining a threshold 



74 further comprising the steps of: 
'elief value discriminating main subject 



regions and background regions, and wnerein 

said altering step comprises the step of desaturating the pixels in 
said background regions. 



V 
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76. The method ii^laim 75 wherein said desaturation step 
comprises the steps of: 

calculating the luminailpe values for the pixels in said background 

regions; 

replacing the color value^ of the pixels in said background regions 
with their respective luminance values. 



the steps of: 



77. The method of Claim Y4 wherein said altering step comprises 



computing a saturation vah e for each pixel, and 



altering the pixel saturation 
belief values. 



values according to said associated 
4 further comprising the steps of: 



78. The method of Claim 

determining a threshold belief value discriminating main subject 
regions and background regions, and wherein 

said altering step comprises the step of enhancing saturation of the 
pixels in said main subject regions. 



79. The method of Claim 74 further comprising the steps of: 
determining a threshold'belief value discriminating main subject 
regions and background regions, and wherein 

said altering step comprises the steps of: 

computing a saturation value for each pixel in said background 
regions, and 

altering the pixel saturation values in said background regions 
according to said associated belieff values. 



80. The method? of Claim 74 further comprising the steps of: 



\ 
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determining a thr^hold belief value discriminating main subject 
regions and background regions, ancl wherein 

said altering step compidses the steps of: 

computing a saturation vjjlue for each pixel in said main subject 
regions, and 

altering the pixel saturatioi\ values in said main subject regions 
according to said associated belief values. 



81. The method of Claim 1± wherein said altering step comprises 



computing a luminance value for each pixel, and 



altering the pixel luminance 



values according to said associated 




the steps of: 



belief values. 



82. The method of Claim 7 
determining a threshold beli = 
regions and background regions, and wherein 

said altering step comprises tihe step of altering the pixel luminance 
values in said main subject regions according to said associated belief values. 



further comprising the steps of: 
if value discriminating main subject 



83. The method of Claim 74 further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and wherein 

said altering step comprises the step of altering the pixel luminance 

values in said main subject regions according to said associated belief values. 



84. The method of Claim 74 wherein said altering step comprises 



the steps of: 



computing a hue valu< 



for each pixel, and 



\ 



values. 
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altering the pixeNiue values according to said associated belief 



85. The method of Claim 74 further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and wherein 

said altering step compmses the step of altering the pixel hue values 

in said main subject regions according to said associated belief values. 



86. The method of Claim 74 further comprising the steps of: 
determining a threshold belief value discriminating main subject 
regions and background regions, and wherein 

said altering step comprises the step of altering the pixel hue values 



in said main subject regions according to 



aid associated belief values. 



87. The method of Claim 

determining a threshold be 
regions and background regions, and whei 

said altering step comprise^ the step of inverting the pixel hue 
values in said main subject regions. 



? 4 further comprising the steps of: 
ief value discriminating main subject 
ein 



88. The method of Claim/ 74 further comprising the steps of: 
determining a threshold bfelief value discriminating main subject 

regions and background regions, and wherein 

said altering step comprises the step of inverting the pixel hue 

values in said background regions. 



the steps of: 



89. The method of Claim 74 wherein said altering step comprises 



computing a blur value for each pixel, and 



\ 





values. 
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altering the pixel blur values according to said associated belief 



90. The method of ffilaim 74 further comprising the steps of: 
determining a threshold belief value discriminating main subject 

regions and background regions, and Rvnerem 

said altering step comprises the steps of calculating a pixel blur 

value for each pixel, and altering the i ixel blur values in said background regions 

according to said associated belief values. 



